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ABSTRACT 

The speaking ability of 40 Finnish college students 
of English as a Second Language was assessed in tests of 
interactional and transactional language function. In the 
interactional test, the learner introduced a topic of his choice and 
attempted to converse with two native speakers of English. In the 
transactional test, the learner watched a video clip from a 
television crime drama and produced a spoken narrative about what 
happens in the film. The tests were graded by both English and 
Finnish native-speaking teachers. Substantial differences were found 
in grades given to the same students by the different examiners. 
Based on these findings, it is argued that pragmatic breakdown has 
occurred between the first and second languages, and that it is 
sociopragmatic features, which stem from culture-specific perceptions 
of what constitutes appropriate linguistic behavior, that are the 
cause. How such different conventions interfere with understanding 
the intentions of a foreign language speaker is discussed. (MSE) 
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ABSTRACT 



CO forty university-level Finnish learners of Bngttsh ere assessed accord- 
^ ing to their speeWng sbWtisB in teete rearing useof intewtlonal 
£3 end transactional language function. In the Interactional teat the 
Z _ learner Introduce* a topic of We/her own choice and attempts to con- 
LU verse with two nstivo-speafcers of English. In the transactional test 
the earns learner watches a video eMp from a TV crime drama and 
produces e spoken nsrretive about what happens in the fljm. The testa 
are graded by both BngHeh snd Finnish native-speaker lecturers snd 
startling differences are evident in the grades allocated for the -same 
student by the different sets of examiners. It is argued that pragmatic 
breakdown between LI and W baa occured and that it !• »ocioprsgwat- 
ic features (which stem from culture-specific percsptions of wftst 
constitutes sppropriate linguistic behaviour) which ere the cause- flow 
such different conventions Interfere with underetending the intentions 
of a foreign language speaker are discussed In broader terms. 



1. Introduction 

Bvrfuation la the focus of much research and development in applied lin- 
guistics snd foreign or second language teaching. Thte paper la not about 
the testing of spoken language so much ea an expression of concern over 
soma of the variables affecting such evaluation which raises a couple of 
questions. 

Firstly v why do the variables crests unexplained variations of scores 
for the same person at the same time In particular types of spoken lan- 
guage exemtaalionaT Secondly, la it variables such as these which provide 
O impetus for the sort of degrading and very definitely invalid assertion 
^ which follows: g e otNurrvtwT or t dvcatkw 
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Finns a** mere beggars of love and affection, deeply insecure persona 
unable to love and confront open conflicts. The results are clear? we 
are a humble subservient folk; We beat those who are **d »«* 

the self-security to be tender. . . Sometimes we are explicitly sanctioned 
for showing our love, Joy or hatred... People may get emrtoua about 
your happiness.,. Envy, that's the main characteristic of the Finns. 
(Moore and Soto 1981), 

This paper will discuss these two questions in relation to spoken 
language as it is taught and used in crose-cultural situations. It supports 
the argument that we understand the nature of language by looking at how 
it is used in communication, its pragmatic dimension. 



2. The background 

It may be useful to familiarise ourselves with some of the terms used in 
this paper. In using 'cross-cultural 1 we refer to the different groups that 
rosy operate within any given society or culture. In this way we can avoid 
referring to any particular nation or culture as having a specific aet of 
pragmatic noma embodied in ita language and used by ita members. These 
groups may be localised in areaa, professions , religions, cults, sub- 
cultures, etc. Thus we can see cross-cultural as being used to refer to 
communication between any people who do not share a common cultural 
bock ground. 

It Is obvious that different groups of speakers differ in their choices 
of linguistic expression. For example, one group may not make contextual- 
iaation overt, whereas another may explicitly contextualise. filling in 
pronoun referents and background information, making assumptions, and 
using metalanguage, in other words comment on the talk itself. In pragmat- 
ic terms, different groups follow differing language delivery rules. 

Vflthin each society the symbols which comprise its cultural semiotic 
systems are. of course, In a continuous state of adjustment and alteration. 
Those changes represent important cultural and social processes, eg. those 
of struggles for power and the formation and reformation of networks of 
human relationabips. And thie movement is certain to be manifested at the 
pragmatic level. 

Charles Saunders Poirce (1976) remarked: "It is a strange thing, when 
one comes to ponder over it, that a sign should leave its interpreter to 
supply a part of its moaning. * Strange indeed but the hearer is required 
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to draw upon ■ wealth of world experience and knowledge of ■ general 
kind In order to crake sense of individual words, utterances, discourse, 
non-verbal and poraHngulBtic features of language use. 



3. The method 

In tnie paper these points are discussed in relation to the evaluation of 
foreign language fluency. The focus will be on the ways in which a hearer 
decode* some of ths pragmatic aspects of atudent-talk found In spoken 
language examinations at a university in Finland. 

In this project U Flnnlah learners of English were ssssssed according 
to their fluency in the language. All the learners hsd been or were to be 
studying s foreign Isngusge other then BngUsh, such as French. German 
or Swedish. 

The first test, called a 'Conversation Test', Involved the student in 
conversation with two nstive-speakers of English on a subject of tho 
student's choice for about ten minutes. The examiners evaluated each stu- 
dent performance and allocated a grade on a ten-point scale. The student 
talk wss marked utterance by utterance. 

Shortly after this conversation tost the students were invited to sit a 
second test. They knew that their tslk would be graded but these grades 
would not be filed. In this test the students first watched a flvc-minute 
video clip from a TV play by Alan BleasdaJc. Before seeing the extract 
they wore told that they were to be aaked the questions Deacribe what 
happened aa though you were in the role of a byatander /eyewitness. 
Immediately after seeing the film extract, which wss predominantly a street 
scene, each student attempted to onawer this queation in the presence of a 
native-speaker of English. The English speaker provided non-verbal feed- 
back and rein forcers. 



«. The situation and function 

The film extract opens with a street scene in which two social workers try 
to persuade s man, the father of three children, to allow access to Ms 
home. The children ore in no immodisto danger. This occurs whilst some 
police officers sit outside ths house in s csr. The men refuses entry for 
fesr that the social worhera wilt take hia children sway from him. The 
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police fores sn entry into the house, attack and brutally beat the man into 
submission. At the end of the clip a young child ahoota at a policeman 
with an air rifle (*«. not wounding him seriously) and another child vio- 
lently strikes a sympathetic social worker. Although shocked snd sngry 
the socio! workers present on the scene are unable to prevent the police 
violence being Inflicted on the man. 

It is an extract which is low in dialogue but high in action and drains. 
The first test, the Conversation Teat, draws on interactional skills. 
Interactions! lnnguage function concerns the development and maintenance 
of social relatione. It is listener-orientated and is the primary function of 
spoken language. One main purpose ia the expression end enjoyment of 
shared experience. It is closely bound to the expression of personality 
and. thus, culture. 

The second examination, the Narrative Test, drawa on transactional 
skills. Transactional language function is essentially about the transfer of 
information from one source to another, The message is the reason for 
ta.'king and the moaaage must be understood by the bearer. 

Interactional skills are the primary function of spoken language, 
snd tend to serve a Private language function. Private language delivery 
tends to be unplanned and thus spontaneous to some extent. Its form is 
regarded ss deviant from prestige language forma. Transactional skills 
serve a Public language function. Public language delivery ia more likely 
to be rehearsed or planned and more likely to represent prestige language 
norms. 

PregmaHnguistlc differences between languages refer to the differing 
means that any language might have for conveying the degree of force in 
any particular iUocution. Across cultures these may be found in the use of 
directives, apologias, requests, etc. Work haa been done elsewhere in 
relation to pragmatic breakdown caused by pragroaJinguiatic differences 
between the Englishes and Finnish in which speech act strategies are 
inappropriately transferred, and theaa play a minor role in what is de- 
scribed here. 

Soctopragmatic differences stem from cross-culturally different per- 
ceptions of what constitutes appropriate linguistic behaviour. These might 
include wsys of initiating and ending discourse, turntaking. treatment of 
silences in conversation snd use of nonverbal sign ailing devices. Socio- 
pragmatic featuree concern the social conditione placed on language use In 
any context. 
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5. The results 

The conversation test was marked by two nstlvc speakers of English. Both 
exams were graded according to lexis, grammar, pronunciation, and con- 
tent. The narrative test was marked by three sets of examiners: two 
nstlve-speskers of Bngllsh; two nstive-speskers of Finnish who had seen 
the film extract prior to grading and two who had not . 

The resulta of these examinations reveal two curious features. On the 
one hand, there was often a conaiderable difference between the grade 
allocated for the aame student in the conversation test and the narrative 
test. In one caae thia involved a difference of six points (out of ten). On 
the other hand, there wee also a substantial difference between the grades 
allocated by the Engliah and Finnish native-apeakers for the narrative 
teat. Many of these fluctuate up and down between the sets of scores. 
These differences indicated that it was not merely fluency in a foreign 
language that was being tested here but ability to perceive snd ndhore to 
certain social rules governing communicative context. 

The sample was not large enough to produce a normal distribution 
curve, and the test variable was very low at 0.9128. However, difference* 
exist between the scores snd the reasons for these differences may He with 
pragmatic breakdown between English and Finnish end differing concept of 
situation. Some of these are culture-bound and others are idiosyncratic. 



6, Discussion 



It appeara that a few of the students who did psrttcularly well in the 
conversation test may have been those who used certain interactional 
language forms, increasingly common in private language, such ss semantic 
frames (which serve to signal that the stretch of an utterance la to be 
taken in a particular manner, eg. expressing opinions, convictions, person- 
al viewpoints, evaluation); meana of argumentations or subject expansion ; 
slgnala of social context (eg. turn-taking signals or stste-of-conactouancaa 
signals Indicating what a person is reedy to do) end communication control 
signals (cf. Keller 187S). 

The analysis of spoken discourse reveale that indeed these sre fea- 
tures of spoken interaction, and the student who have uaed them have 
been credited accordingly. But a took at the reports of the student testa 
in which low grades were attained reveals startling statement 8: 
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Student A: no initiation 

B : not fast enough in delivery 
C: making statements and not conversing 
D: thoroughly undo-operative 
E; no content to answer 
F; shotgun delivery 
G: rather passive 
H; talks in short phrases 
i: not very wining to elaborate beyond a 
sentence or two and needs prompting 
J: not very convincing gestures 
K: needs some prompting 
L: slow and boring 
M: hesitant, very Finnish 

Let us take some quotes Trom the reports of the students who did 
noticeably better in the conversation test: 

Student A: can fUl up a silence 

B; has quick reponses to questions 

C: has good physical responses 

D; is able to interrupt 

E: is quick, lively and not wooden 

F: is very talkative and carries the ball 

(i; shows interest 

1! : has good gestures 

The argument here is simply this: As experienced language users the 
Finnish students Me obliged to Judge the parameters of the aituation are 
the communicative context, and attend to the form of language that they 
deliver in ttie conversation test. The situation here appears to descend 
interactional, private use of language, and yet the context la far fwxn 
suitable for «ia deemed* made of the student for interactional language 
delivery. Tuis is Widen* in eelf-mporting sieteteeats made by students 
iitdieatiag If* fceBitf c* kavtog onetfe personality on trial ie the teat. 

The student is likely to be perplexed over the weighting of inter- 
Clonal and _t*nseettoi£l fuqetW* because i*e situation is ** clearly 
defined, and what ia defined to ofleh contradictory, fn other words, how 
can conversation frrivete and tote*acttenel> be developed In 4 10-poini 
formal gfaded context? This pragmatic breakdown through mishandling of 
certain eoctopragmattc rules between Finnish and English casts the validity 

of the test in some doubt, 

tet us move to the students who scored substantially different results 

on ths narrative test. 

In the narrative test the student presumably knows what is expected: 
the message is the reason for talking and the message must be understood. 
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So why to there a difference between the evaluations by English- and 
Finnish-speaking examiners? 

The student who describe the chain of events and tslfc about those 
events ere those who do noticebly better on the English-speakcr-evaluated 
narrative. Some also opened and closed the narrative with some comment on 
the film extrsct. Others provided opinions evaluating the conduct of the 
police, the social workers* the father end the children. Others compared 
the behaviour with that likely to be found in such a situation in the 
Scandinavian or Finnish context. 

You will remember that the film extract depicted police behaviour which 
was clearly unneccesarlly violent with a corresponding lack of interference 
by the social workers on the scene. The bait was thpr* and and the ftsh 
that bit were rewarded; they interpreted the events although they were 
not explicitly asked to do so* Remember the question put to the students 
waa a demand to recall the chain of events leading to the children being 
taken away by the social workers. Comment on the moral and ethicnl 
implications of the action taken by the authorities waa not requested, Some 
students provided that meia-eomment and were duly reworded and some did 
not. These differences are probably due to different definitions of the 
narrative being performed and these are probably soriopragmatic. 

In reference to Brving Uoffman. Deborah Tannen (1980) suggest* that 
such inclusion of mete-comroent in narrative is a particularly North 
American phenomenon. Could it be that even though the context in which 
the narrative waa produced was carefully controlled and defined we still 
have soctopragmotic problems occuring? 

Ooffman writes (lift 9) that any verbal performance is an exercise in 
the presentation -of-self. Is thia what the English examiners regard as 
idng on the cake whilst the Finnish examiners do not regard that coke as 
needing icing? In turn does this not cast doubt on the way in which such 
teats are canned out? The implications of this may go far in relation to the 
evaluation of language use in all its different forms. 

Within each culture there are groups which respect and follow different 
cultural and social systems, A language belongs to each and everyone who 
uses it. Each user tints it in some way or another, and thia usually adds 
to the wealth and scope of that language. 

Soetopragmatie breakdown is not ao much a case of a producer beinp 
necessarily 'wrongs t rudeS or •shotgun* , but perhsps the interpreter 
being ignorant and diaplsying prejudice. And when such persons hove the 
authority to judge the linguistic performance of another then they may be 
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unwittingly abusing the power b— to w ed upon tbsw. Correct, psrmtsssble 
Mid appropriate language uaage art ttroi that some practtoners to the 
field uaed to ^-evaluate, Recant developments In pragmatics enable them 
to do so. 
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